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Abstract 

The zenith angle distributions of atmospheric neutrinos are determined by the possible presence 
of neutrino oscillations and the combination of three most important contributions: (1) geomagnetic 
effects on the primary cosmic rays, that suppress the primary flux in the Earth's magnetic equatorial 
region, (2) the zenith angle dependence of the neutrino yields, due to the fact that inclined showers 
produce more neutrinos, and (3) geometrical effects due to the spherical shell geometry of the neutrino 
production volume. The last effect has been recognized only recently and results in an important 
enhancement of the flux of sub-GeV neutrinos for horizontal directions. In this work we discuss the 
**"~^ geometrical effect and its relevance in the interpretation of the atmospheric neutrino data. 

Oh! 1 Introduction 

Atmospheric neutrinos are produced in the hadronic showers generated by cosmic rays 
in the Earth's atmosphere. Absorption in the Earth is negligible in the entire relevant 
energy range, and therefore a detector located near the surface of the Earth will receive a 
neutrino flux from all directions. In the presence of neutrino oscillations the observed rates 
of v interactions will be modified, and the angular distributions distorted. These effects 
have been in fact measured by Super-Kamiokande fl|] and other atmospheric neutrino 
detectors || El, Hi anc ^ & ve c l ear evidence for the existence of flavor transitions . 

The evidence for oscillations is robust, and does not depend on a detailed calculation 
of the expected neutrino fluxes with and without neutrino oscillations. The strongest 
evidence comes in fact from the detection of an up-down asymmetry in the angular 
distribution of muon events and in a small ratio for the rates of /i-like and e-like events. 
It is possible to predict with very simple considerations that in the absence of oscillations 
the v fluxes are approximately up-down symmetric, and the fluxes of electron and muon 
neutrinos are strictly related because they are produced in the chain decay of the same 
parent mesons. In order to extract the oscillation parameters from the data it is however 
important to have detailed predictions for the expected intensity and angular distributions 
of the no-oscillation fluxes. 
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In this work I will discuss the angular distributions of the atmospheric neutrino fluxes. 
These distributions are determined by the presence of neutrino oscillations (if they exist) 
and a combination of three most important effects: 

1. Geomagnetic effects on the primary cosmic rays. Low rigidity particles cannot reach 
the vicinity of the Earth, and the effect depends on the point of the Earth where cos- 
mic rays arrive (being stronger near the geomagnetic equator), and on their direction 
(local zenith and azimuth angles). 

2. The zenith angle dependence of the neutrino yields. Inclined showers produce more 
neutrinos that vertical ones because the decay of charged mesons and muons is then 
more probable. 

3. The spherical geometry of the neutrino source volume. This results in an enhance- 
ment of the neutrino fluxes from horizontal directions and a suppression for the (up- 
going and down-going) vertical directions. The effect is exactly up-down symmetric, 
and is important for sub-GeV neutrinos. 

Additional smaller effects are due to the bending of charged particles during shower 
development, the presence of mountains, and the existence of different air density profiles 
over different geographycal regions. 

The aim of this paper is to discuss in particular the effect of the spherical geometry 
of the neutrino source region. This effect has been recognized only recently ||, is not 
included in the calculations currenty in use § in the analysis of experimental data and 
is still the object of some controversy. 

The work is organized as follows: the next section contains a discussion what is the 
one-dimensional (ID) approximation used in the first calculations of the atmospheric 
neutrino fluxes and why the approximation was considered necessary; section 3 and 4 
present for completeness very brief qualitative discussion on the geomagnetic effects and 
of the angular dependence of the neutrino yields; section 5 discusses the geometrical 
effects related to the shape of the neutrino source volume; section 6 presents the results 
of a detailed calculations; section 7 gives a summary. 

2 The one— dimensional approximation 

Any cosmic ray shower, produced by a primary particle interacting in an arbitrary point 
of the atmosphere, with an arbitrary direction can result in one (or more) neutrinos with 
trajectories that intersect the detector in consideration. Of course only a very small 
fraction of the cosmic ray showers produce neutrinos that pass inside (or in the vicinity) 
of a detector, and therefore a full montecarlo calculation of the neutrino fluxes appears 
as extremely inefficient. 

It is because of this difficulty that the first generation calculations of the atmospheric 
neutrino fluxes have been performed in what is called the one-dimensional approximation. 
In this approximation one considers only a very small subset of all possible cosmic rays 
primaries, those that have a trajectory that when continued as a straight line beyond the 
interaction point intersects the detector. The neutrinos produced in the showers of these 
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primaries are considered as collinear to the primary parent, and also have trajectories 
that intersect the detector, therefore all z/s generated in a montecarlo calculation can be 
collected and analysed to estimate the atmospheric neutrino fluxes. 

More explicitely, in a 1-D calculation the flux of neutrinos with flavor a, energy E v 
and direction Q observed by a detector located at the position x d is calculated as: 

(f> Va (E v ,£l v ,x d ) =y^ f dE Q ^ A [E Q ,Q Q (Q v ),x Q (Q v ,x d )] dn f^ Ua (E v ; E ,cos9 ) (1) 

the sum is over all primary cosmic rays nuclear species, the quantity driA^v a / dE v is the 
differential yield of neutrinos of flavor a from a primary of type A, energy Eq and zenith 
angle 8q, (Pa(E ,Q ,xo) is the flux of primary cosmic rays of type A , energy E and 
direction Qq that reach the Earth at point xq. The dependences on the direction and 
position for the primary flux are the consequence of geomagnetic effects. Since neutrinos 
travel along straight lines, the interaction position of the primary flux is determined to a 
good approximation by the neutrino direction Q u . All down-going neutrinos (cos9 u > 0) 
are produced in showers in the general vicinity of the detector: xq — Xd, while for up- 
going trajectories (cos9 u < 0) the primary interaction point is in the vicinity of the 
point where the neutrino enters the Earth. The crucial approximation made in the 1- 
D approximation, is to consider also the direction of the primary Q as determined by 
Q u . For down-going neutrinos this simply means Qq ~ Q u , and for up-going neutrinos, 
expressing Qq as a zenith and azimuth angle with respect to the local vertical, this means: 
Q = (cos6> ,y?o) = (-cos9 u , <p v ). 

Equation (|I|) simplifies enormously the calculation of the atmospheric neutrinos fluxes 
because now only a very small (indeed infinitesimal) fraction of the cosmic ray showers 
has to be studied. About half of these showers have trajectories that reach the Earth 
near the detector point (arriving from all directions in a 2n solid angle), the other half is 
distributed over the entire surface of the Earth, but a unique direction has to be considered 
for each point (see fig. |l|). 

In the equation ([!]) the problem of the calculation of the neutrino is "factorized" in 
three parts: 

1. Determination of the primary cosmic ray fluxes. These fluxes have of course to be 
measured experimentally. The primary fluxes have also a time dependence due to 
the solar modulation. The effect decreases with momentum, and becomes negligible 
for rigidities p/q > 100 GV. 

2. Calculation of the geomagnetic effects. The primary cosmic ray fluxes reaching point 
Xq from the direction Q can be calculated from the isotropic flux unperturbed by 
geomagnetic effects (that is measured in the Earth's magnetic polar regions) with 
a knowledge of the structure of the geomagnetic field, testing if the trajectories are 
allowed or forbidden. 

3. Calculation of the neutrino yields. The number of neutrinos (and their energy spec- 
trum) produced by a primary of energy E and zenith angle 6 Q can be calculated 
studying the average development of hadronic showers in the atmosphere. 
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Figure 1: Relation between the zenith angles of the neutrino (8 V ) and the primary particle (9q) m the 
1-D approximation. 

A calculation using a three-dimensional method can still be considered as divided 
into the three parts discussed above, and indeed the first two steps are identical. The 
calculation is however much more complex because it is not anymore sufficient to consider 
for the neutrino yield simply the inclusive energy distribution of the neutrinos produced in 
a shower, but also the angular distributions of the neutrinos (and their strong correlation 
with the energy) are important and have to be calculated. Moreover the simple integral 
in ([[]) performed over the primary energy E keeping the direction fixed has now to 
be replaced by a more complex convolution that involves not only the energy but also 
the direction of the primary particle, since the neutrinos with a given trajectory can be 
produced in showers with a non collinear axis. 

3 Geomagnetic effects 

An assumption common to all atmospheric neutrino calculation, is that the fluxes of 
cosmic rays at one astronomical unit of distance from the sun, when they are not perturbed 
by the near presence of the Earth are isotropic, and can be simply described by their energy 
dependence <Pa{Eq). The fluxes reaching the surface of the Earth are however affected 
by the geomagnetic field and therefore are not isotropic, and have different intensities in 
different locations. For example it is intuitively clear that low rigidity particles can reach 
the Earth only traveling parallel to the magnetic field lines arriving near the magnetic 
poles, while high rigidity particles can reach all points on the Earth's surface from all 
possible directions. 
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Given a map of the magnetic field around the Earth it is a straightforward exercise to 
compute numerically if a given primary particle three-momentum and position correspond 
to an allowed or a forbidden trajectory. It is sufficient to integrate the equation of motions 
of the charged particle in the geomagnetic field, and see if the past trajectory of the 
particle intersects the Earth's surface, remains confined to a finite distance from the 
Earth (forbidden trajectory); or originates from large distances (allowed trajectory). 

For a qualitative understanding it can be useful to consider the historically important 
approximation of describing the Earth geomagnetic effect as an exactly dipolar field. In a 
dipolar field the problem can be solved analytically. All positively particles with rigidity 
R > Rg are allowed and the trajectories of all particles with R < Rg are forbidden 
because they remain confined to a finite distance from the dipole center []. The quantity 



R s (x, h) is the Stormer rigidity cutoff [T(| : 



. . , „ . (M\ { cos 4 A M 1 , v 

Rs r , A M , 9, <p = l—jl < h , — \mu( 2 

\2rv [ [1 + (1 — cos 6 Am smO smtp) 1 ' 2 ] 2 J 

where we have made use of the cylindrical symmetry of the problem, M is the magnetic 
dipole moment of field, r is the distance from the dipole center, Am the magnetic latitude, 8 
the zenith angle and ip an azimuth angle measured counterclockwise from magnetic north. 
For negatively charged particles the cutoff is obtained with the reflection ip — > ip + n, that 
is exchanging east and west. 

The qualitative features that are important for our discussion are the following: 

1. For a fixed direction the cutoff rigidity grows monotonically from a vanishing value 
at the magnetic pole to a maximum value at the magnetic equator. 

2. The cutoffs for particles traveling toward magnetic west are higher than those for 
particles traveling toward magnetic east. Note that geomagnetic effects are the only 
mechanism discussed in this work that can generate a non-flatness in the azimuthal 
angle distributions of atmospheric neutrinos. 

3. The highest cutoff corresponds to westward going, horizontal particles reaching the 
surface of the Earth at the magnetic equator (<p = 90°, 9 = 90°, Am = 0°). The 
maximum rigidity cutoff is approximately 60 GV. All geomagnetic effects vanish for 
particles above the rigidity value. 



4 The neutrino yields 

The "neutrino yield" is the average number of neutrinos of a certain flavor produced 
by a primary cosmic ray particle. It depends on the primary particle type, energy, and 
zenith angle. There are also weaker dependences on the azimuth angle of the shower 
and its geographycal locations due to the effects of the geomagnetic field on the shower 
development. 

1 In this solution it is assumed that the field fills the entire space. A fraction of the allowed trajectories have really a 
segment "inside" the Earth (with r < R®) and therefore should be considered forbidden also in a dipole field. 
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In the 1-D approximation the angles of the secondary particles with respect to the 
primary directions are neglected (or integrated over), and therefore the neutrino yields 
can be described simply as a set of functions that give the energy distribution of the 
neutrinos (of different flavors) produced by primaries of given type, energy, and zenith 
angle. 

The one-dimensional neutrino yields have been obtained with the integration (nu- 



merical || [II], [L2|] or even analytical in simplified tratments |[L3|| ) of a set of differential 
equations that describe the average development of hadronic showers. The most accurate 
calculations of the yields are however performed with montecarlo techniques. A large 
number of showers (for primary particles of different type, energy and zenith angle) is 
generated, and the number, flavor and energy of all produced neutrinos is recorded to 
compute numerically the neutrino yields as a function of primary energy, direction and 
particle type. 

The authors of the montecarlo calculations of the yields J7], || have also usually made 
the approximation of considering all secondary particles in the shower as collinear to the 
primary particle. This can be obtained "rotating" all final state particles so that their mo- 
mentum is parallel to the projectile (or parent) particle, and neglecting multiple scattering 
and bending in the geomagnetic field. Strictly speaking this rotation of course implies a 
small (negligible) deviation from exact conservation of the longitudinal momentum. In 
the procedure energy is exactly conserved. 

The neutrino yields have some important dependence on the zenith angle of the primary 
particle. The yields grow monotonically when the zenith angle of the primary particle 
changes from the vertical to the horizontal direction. The reasons for this growth are 
simple to understand, and originate from two effects. The first effect is simply that an 
inclined shower develops in air for a longer distance before hitting the ground, therefore the 
muons produced in high zenith angle showers have more time to decay in air and produce 
more neutrinos. Essentially all muons that hit the ground rapidly lose all their energy 
in ionization and radiation processes and decay at rest producing very soft neutrinos 
(with E v < m M /2) that can be neglected because are below the thresholds of the existing 
detectors. 

A second effect, contributing also to an enhancement of neutrino production for hor- 
izontal showers is due to the fact that the air density is not constant but decreases (ap- 
proximately exponentially in the stratosphere) with increasing altitude. Therefore the 
inclination of a trajectory (assuming the same starting point) determines the column 
density X (g cm -2 ) that corresponds to a fixed length L (cm). The column density is 
largest for vertically down-going particles (zenith angle 8 = 0) and decreases monotoni- 
cally with increasing zenith angle. The relation between L and X determines the relative 
probability of decay or interactions for charged pions (or kaons), and the energy loss of 
a muon before decay. A smaller X (for a fixed L) implies that the interaction of weakly 
decaying mesons is suppressed and their decay enhanced; it also means that the muons 
will decay with a higher energy. For inclined showers the first effect results in a higher 
number of neutrinos, and the second one in a slightly harder spectrum of neutrinos 

The ratio between the vertical and horizontal yields is a function of the neutrino 
energy. For low E v the ratio is close to unity, and there is very little enhancement 
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for the horizontal directions. This can be qualitatively easily understood. Low energy 
neutrinos are produced in the decay of low energy pions and low energy muons. Because 
of relativistic effects the decay length of unstable particles is proportional to the particle 
momentum, for low energy particles the decay is so rapid, that the decay probability is 
unity, and the energy loss before decay is negligible independently from the direction of 
the particle. In these circumstances there is no enhancement for the horizontal directions, 
and the yield is isotropic. With increasing energy the decay length increases, and the 
effects outlined above start to be significant. As an illustration, the muon decay length is 

^ = ^ — = 6-23 p M (GeV) Km (3) 

The muons are produced at an average altitude of ~ 17.5 Km (~ 30 Km) for vertical 
(horizontal) particles with only a weak energy dependence. For p^ < 1 GeV, most muons 
decay independently from their direction. For p^ = 3 GeV (10 GeV) the decay of the 
vertical muons is suppressed by a factor ~ 2 (~ 4) while the decay probability of horizontal 
particles remains approximately unity. 

These effects are carefully included in the existing calculations, that in fact give neu- 
trino zenith angle distributions that are approximately flat for low E v (with distortions 
that reflect only geomagnetic effects and the angular distribution of the primary cos- 
mic ray flux), and develop a stronger and stronger enhancement on the horizontal with 
increasing energy. 

5 Spherical geometry of the source 

Most atmospheric neutrinos are produced in a spherical shell of air at an altitude between 
10 and 40 km. The approximately spherical geometry of the source region has some 
very important effects on the angular distribution of the neutrinos and results in an 
enhancement of the neutrino flux from the horizontal directions. This enhancement has 
been overlooked in all calculations of the atmospheric neutrino fluxes before the work of 
Battistoni et al. f|. 

To illustrate the nature of the new effect, let us consider a situation where the ge- 
omagnetic effects are absent (and therefore the flux of primary cosmic rays is exactly 
isotropic), and the zenith angle dependence of the neutrino yield is negligible, that is the 
number of neutrinos produced by a primary particle does not depend on inclination of 
the shower in the atmosphere (as it is the case for low neutrino energy). In this situation 
a one-dimensional calculation predicts an isotropic neutrino flux. This result is incor- 
rect. A realistic (three-dimensional) calculation results in an angular distribution of the 
neutrino flux that is exactly symmetric for up-down reflections, and for rotations around 
the vertical axis but that is not isotropic and exhibits an enhancement for the horizontal 
directions. The enhancement for the horizontal directions depends on the neutrino energy 
and is more and more marked with decreasing energy. 

The origin of this result can appear surprising, and for "pedagogical reasons" it can be 
instructive to consider two simple problems that have clear analogies with the emission of 
neutrinos in thre atmosphere. In problem A an observer is located inside a thin spherical 
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Figure 2: Geometry of the emission from a thin spherical shell with the observer located inside the shell. 



shell of stars of radius R s \ in problem B the observer is inside a spherical cavity in a black 
body with temperature T. In both cases we want to compute the angular distribution of 
the photon flux measured by the observer. 



5.1 Problem A: a shell of stars (isotropic emission) 

Let us consider an observer inside a thin shell composed of isotropically emitting stars 
(see fig. |2|). Let us assume that L Q (erg/s) is the average luminosity of the stars, n is the 
surface number density (cm -2 ) of stars in the shell, and Ra (with Ra < R s ) the distance 
of the observer from the center of the star shell. The energy flux per unit solid angle 
dF{Q)/dVL (erg/ (cm 2 s sr)) measured by the observer can be calculated as: 

l-(^) (l-cos 2 £)J 2 (4) 

where 9 (see fig. 0) is a polar ("zenith") angle around the axis that passes through the 
center of the spherical shell and the observer. 

The solution respects the cylindrical symmetry of our problem (does not depend on 
the azimuthal angle (p) and is up-down symmetric (it remains identical after a reflection 
9 <-> 7r — 6) , but neglecting the special case of the observer at the center of the shell, it is 
not spherically symmetric, and is peaked for horizontal directions (cos^ = 0). When the 
observer is close to the emitting shell (that is when Ra approaches R s ) the peaking is very 
strong, and the observer sees the shell as a narrow bright disk. As a numerical example: 
for Ra — R® = 6371 Km and R s = R® + 15 km, formula (|) predicts a horizontal flux 
14.6 times more intense than the vertical flux (see fig. |||). 
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Figure 3: Angular distribution of the flux received by an observer located inside a shell of isotropically 
emitting material. R s is then radius of the emitting shell, and i? bserver the distance of the observer 
from the center of the shell. The enhancement for 9 ~ 90° (the horizontal plane) becomes stronger when 
-^observer approaches R s . The vertical (up-going and down-going) fluxes are independent from R s and 

-^observer- 



It is elementary to deduce equation (f|). Only stars in the surface element dA subtended 
by the solid angle dQ contribute to the energy flux from that solid angle interval with a 
total of n dA stars (see fig. 0); each star contributes an energy flux L /(47r£ 2 (6 1 )), where 
£(9) is the distance between the observer and the sources in the direction 9. Therefore: 

(dF) iso = ndA — = n — — (5) 

In the second equality we have written explicitely the expression for the area of the 
element of shell seen in the solid angle dQ: dA = dQtl 2 / cos9 e . The area of the shell 
element obviously scales as oc £ 2 , and this factor cancels exactly the factor £~ 2 that takes 
into accout the reduction with distance of the apparent luminosity of the stars, however 
the expression for dA contains also a geometrical term (cos^)" 1 that takes into account 
the orientation of the surface element of the shell with respect to the line of sight. The 
"emission" angle 9 e is the angle between the normal to the source surface (toward the 
center of the shell) and the line of sight from the source to the observer. From elementary 
geometry one obtains: 



COS#p 



1 - ( (1 - oos^) (6) 



It is this factor that is responsible for the strong enhancement of the flux from the hori- 
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zontal direction. 

It is interesting to note that the up-going and down-going vertical fluxes (cos# = ±1) 
are independent from the position of the observer inside the shell, while the horizontal flux 
depends on the observer position, and grows when the observer approaches the emitting 
spherical shell. It follows that the total (angle integrated flux) is a function of the observer 
position: 

(where r = Ra/R s ) and grows monotonically from a value tiLq for an observer at the 
center of the shell to a divergent value when r — > 1. The divergence is connected to the 
fact that an observer exactly on the shell must be (in the approximation we have used of 
a shell of vanishing thickness) infinitesimally close to a star. 



(7) 



5.2 Problem B: a cavity in a blackbody (emission oc cos^e) 

The solution of problem B, is of course well kown, we actually live in a (very large) cavity 
whose walls have a temperature of 2.7° Kelvin. An observer inside a spherical "cavity" in a 
black body (and in fact in a cavity of arbitrary shape and dimension) observes an isotropic 
black body spectrum independently from its position. It can be instructive to deduce this 
well known result from the same considerations used in the previous discussion. The 
surface of a black body emits energy per unit surface and unit solid angle at a rate: 

dL{,b r^A cos# e . . 

-f = (rT 4 (8) 

d\l e 7T 



where a is the Stefan-Boltzmann constant. The emission is not isotropic but decreases 
linearly with the cosine of the emission angle with respect to the normal to the surface 
element. The energy flux from the direction Q for the observer of problem B can be 
calculated as: 

, , A dL bb 1 fdttf\f . cos0 e \ /1\ aT 4 

(dF)» = dA-£-= — (7 7*—* - ) = — dSl (9) 



dil £ 2 IcOSflJ V 7T / \£ 2 J IT 



Note that in this case there is a cancellation not only for the factor £ 2 , but also for the 
orientation factor cos# e . If the normal to emitting surface has a large angle with the line 
of sight, a larger surface (oc (cos# e ) -1 ) can contribute to the emission, but the large angle 
emission is suppressed by a factor cos# e . Combining the two effects one has an exact 
cancellation. The demonstration has been actually general, and is valid for a cavity of 
arbitrary shape or dimension and for an arbitrary position of the observer. 



5.3 Atmospheric neutrinos 

We can now come back to the problem of atmospheric neutrinos. The source volume of 
atmospheric neutrinos is also with very good approximation a spherical shell with the 
observers placed inside, very close to the inner radius of the source volume. However 
an element of atmosphere emits neutrinos with an angular distribution that is neither 
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isotropic, nor linear in zenith angle, therefore we can expect a neutrino flux at sea level 
with an angular distribution with a form that is intermediate between the solution for 
problem A (isotropic emission in the source and strong horizontal peaking of the observed 
flux) and problem B (emission oc cos 9 e in the source and isotropic observed flux) . 

Let us consider an isotropic flux of cosmic rays that impinges on the Earth atmosphere. 
The quantity Cq that is the number of cosmic rays absorbed per unit time by an element 
of unit area of the atmosphere (units cm -2 s _1 ) can be calculated as: 



(the integration is over one hemisphere). Note that the absorption rate of cosmic rays is 
proportional to cos#cb with 6 the angle between the normal to the surface element and 
the cosmic ray direction. If the cosmic rays produce an average number (n v ) of neutrinos 
per showers, then each element of the atmosphere is also a source of neutrinos, with an 
emission rate S u = Co (n u ) (again in units cm -2 s _1 ). 

The angular distribution of the neutrino emission from a "patch" of atmosphere is 
not easy to calculate and depends on the average angle between neutrino and primary 
particle. Knowing this distribution it is possible to calculate the observable flux at sea 
level, following the same steps outlined above. 

The results for two limiting cases are easy to obtain. If the neutrinos in a shower are 
produced collinearly with the primary trajectory (Q u = Qq) then the angular distribution 
of the neutrino emission from a surface element of the atmosphere is oc cos8 u , because it 
simply reflects the angular distribution of the absorbed primary flux (see equation flTU|)). 
From equation ([]) (neglecting the angular dependence of the neutrino yield) it follows 
that the observed neutrino flux is isotropic. 

The opposite limiting case is obtained when then neutrinos are emitted quasi isotrop- 
ically in the primary cosmic ray showers. This is approximately true only for very low 
neutrino energy, [E v < 10 MeV). In this case all memory of the direction of the primaries 
is erased, and the neutrino emission from an element of the atmosphere is isotropic. From 
equation @ it follows that the angular distribution of the observed neutrino fluxes is very 
sharply peaked for the horizontal directions. Considering the altitude distribution of the 
neutrino production points (that is related to the density profile of the atmosphere and 
the value of the hadronic cross sections) it can be estimated that for the very low energy 
neutrinos that are emitted quasi-isotropically, the flux on the horizontal plane is more 
than an order of magnitude more intense than in the vertical directions (see fig. 

In general neutrinos are emitted in a cone with an axis that corresponds to the primary 
particle direction and an opening angle that shrinks with increasing neutrino energy. 
We can therefore expect that the emission of the neutrinos from the atmosphere is in 
general intermediate, between the two extremes corresponding to isotropic emission, and 
an emission oc cos# e . The two limiting cases are approached for very low neutrino energy, 
when the neutrino emission is very poorly correlated to the primary direction, and for 
high energy neutrinos when because of the Lorentz boost, the neutrinos are emitted 
quasi-collinearly with the primary particle. 

These expectations can be verified with more detailed calculations. As an illustration, 
let us consider the simplified problem where (i) the atmosphere is formed by a single thin 




(10) 
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layer at an height h (the radius of the emitting layer is therefore R s = + h); (ii) the 
primary cosmic ray flux is exactly isotropic; (hi) the neutrino production is independent of 
the zenith angle of the primary particle; and (iv) the angle 9q u between each neutrino and 
its primary particle has a fixed value 9q u = a (and the emission has cylindrical symmetry 
around the axis defined by the primary particle trajectory). The problem is to compute the 
the neutrino flux received from an observer located at sea level. This simplified problem 
contains essentially all the interesting geometry of atmospheric neutrino production ||. 
Defining r = R®/R s , and S u = 7T(f) (n u ) the number of neutrinos emitted per unit time 



and unit surface by the emitting layer, the solution can be written as: 



S 

l„(fi„,r,a) = ~~~ 

Z7T 



F a (y) 



y=y/l-r 2 (l-cos 2 9„) 



(11) 



with (for a < 90°): 

r o 



F a (y) 



cos a y - 



, 2 cos a y 



— cos a y tan 1 



set y y/T- 



cos^ ot — y 



cos 2 Q+y 2 — 1 



for y < — sin a, 



for y < | sina| 
for y > sin a. 



(12) 

For a > 90° one has to substitute: F a (y) = F w _ a (—y). This solution can be easily 
checked numerically with a montecarlo method writing a simple program with few lines 
of computer code. Some examples of the solution are shown in fig. |] and fig. [|. For 9q v — > 
the observed neutrino flux is isotropic with a value (p v = O ( n u) where O is the isotropic 
primary flux and (n u ) the average number of neutrino produced by a primary particle. 
When the angle 9 0u grows the observed flux is suppressed for the vertical direction and 
is enhanced on the horizontal plane. The suppression and enhancement become more 
important when the angle Oq^ increases. For example (see fig. |j) if the neutrinos are 
produced at an height h = 20 km and are emitted with an angle 9q v = 10°, 30°, or 60° 
with respect to the primary particle direction, the observed neutrino flux at sea level has 
a horizontal/vertical ratio of 1.45, 3.25, and 8.5. 

It is important to observe that the enhancement for the horizontal directions for a 
fixed angle 9 0u depends on the ratio r = R & /R s (that is on the altitude of the neutrino 
production), and is stronger when the altitude decreases. On the contrary the suppression 
for the vertical direction does depend on the angle 6q v but is independent of the ratio 
R^/Rs (see equation (|i~2"D and fig. ||). An important consequence of this is the fact that 
the average (angle integrated) neutrino flux observed at sea level depends on the altitude 
of neutrino production, and grows when the average altitude of production decreases. 
This can easily understood qualitatively observing that for finite 9q v a fraction of the 
produced neutrinos will "miss" the Earth because are emitted on trajectories that do not 
intersect her surface. The fraction neutrinos "lost in space" will decrease if the production 
points are closer to the surface. 

It is less intuitive to note that for large 9$ v the flux of neutrinos in a full 3-D calculations 
can be higher than what is obtained in a collinear approximation. This can be checked 
integrating over angle equation (|H|) and it is possible because the enhancement on the 
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Figure 4: Angular distributions of the neutrino flux emitted by a spherical thin layer of atmosphere of 
radius R s = Rq + 20 Km, and observed at sea level. It is assumed that the atmosphere layer receives an 
isotropic flux of cosmic rays, that the average number of neutrinos produced in a shower is independent 
from its zenith angle, and that the angle between the v and the primary particle has a fixed value. The 
three curves are calculated for values 6q v = 10°, 30° and 60°. With increasing 9q v the vertical flux 
becomes more and more suppressed and the horizontal flux more and more enhanced. 

horizontal plane can be stronger than the suppression on the vertical. This does not 
represent a violation of "unitarity" since it can happen only for a small range of radii just 
below the source region in the atmosphere, while in most of the volume inside the Earth 
for larger 9 0l/ the flux is suppressed. 

From fig. H] and fig. [| one can see that the height of neutrino production is very im- 
portant in determining the enhancement for the horizontal directions. To compute the 
geometrical effects for atmospheric neutrinos it is not possible to approximate the emis- 
sion volume as a thin surface. The results for a thick shell can of course be obtained 
integrating over a continuos distributions of thin shells with different radii, The assump- 
tion of emission from an altitude of ~ 15-20 km can also give a reasonable first order 
approximation. 

In summary this "geometrical effect" can be very important for low neutrino energy. In 
a realistic calculation it must be of course be combined with the other effects: geomagnetic 
effects and the zenith angle dependence of the neutrino yields to determine the angular 
distribution of atmospheric neutrinos. 

It has been stated that the enhancement on the horizontal is the result of the inclusion 
in a 3-D calculation of primary particles with "grazing" trajectories that if continued 
would not intersect the Earth's surface and are not included in a 1-D calculation. These 
grazing trajectories give a neglible contribution to the horizontal neutrino fluxes, and are 
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Figure 5: Angular distributions of the neutrinos produced by a thin spherical layer of atmosphere of 
radius R s = + h with h = 10, 20, 30, 40 and 50 Km. It is assumed that the layer of atmosphere 
absorbs an isotropic flux of cosmic rays and that the neutrinos are emitted at a fixed angle 9 0v = 60° 
with respect to the primary particle direction. The enhancement for the horizontal directions becomes 
stronger when the emission layer is closer to the observer. The vertical (up-going or down-going) flux is 
independent from the radius of the emitting layer. 



not the source of the enhancement. The large flux from the horizontal directions can 
be understood as the effect of the production of "horizontal" neutrinos from the more 
numerous "vertical" showers after emission with an appropriate angle with respect to the 
shower axis. Note than an isotropic flux implies that most of the interacting tracks are 
in fact vertical (the absorption rate is oc cos^o), and therefore the opposite effects of 
"vertical" showers producing "horizontal" neutrinos and vice versa are of different size 
and do not cancel each other. Note also that the enhancement for the horizontal directions 
is linked with a suppression of the vertical fluxes. 

A second 3-D calculation of the atmospheric neutrino fluxes (Tserkovnyak et al. [ pfl ) 
has been recently made public. In this calculation the enhancement of the neutrino fluxes 
for the horizontal direction is not present, and the predicted angular distributions of the 
neutrinos are very similar to those calculated in a 1-D approach. The reasons for the 
discrepancy with the Battistoni et al work |J are not easily understandable from a simple 
reading of the papers. Also an early attempt at a 3-D calculation of Lee and Koh jn| did 
not find a flux enhancement for horizontal directions. As we are trying to illustrate in this 
work the enhancement of the neutrino fluxes in the horizontal directions is the consequence 
of simple geometry and must be present in a correctly performed 3-D calculation. The 
absence of this effect in WM and IT5fl is therefore evidence of the existence of errors it the 



calculation method used for the prediction. 
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6 A complete three-dimensional calculation 



To illustrate the points discussed in the previous section with a concrete example we have 
performed a detailed calculation of the neutrino fluxes with a three-dimensional method. 

The method of the calculation is conceptually very simple. The space around the 
Earth has been divided into two regions: an outer region (r > R 9 + AR where R® = 
6371.2 Km is the Earth's average radius and AR = 80 km) where the matter density is 
assumed to be vanishingly small and only a magnetic field is present, and an inner region 
(Rq < r < R & + AR) where particles interact not only with the magnetic field but also 
with air. The air is modeled as having a spherically symmetric density profile p(r). The 
value of AR was determined calculating that less that one percent of the cosmic rays that 
graze the Earth with a distance of closest approach equal to AR interact in the residual 
high altitude atmosphere. The result of the calculation are independent of AR (if it is 
sufficiently large), but the calculation become inefficient for AR too large, 

The fluxes of cosmic rays entering the spherical surface at R s = i? e + AR were de- 
termined using a model for the isotropic flux in the absence of geomagnetic effects (we 
used the results of primary flux of the Bartol calculation ||), and taking into account the 
effects of the geomagnetic field (we used the IGRF field model UT6| ) in the propagation of 
the particles. This was obtained generating a uniform and isotropic flux that enters the 
spherical surface R s , and rejecting the particles that correspond to forbidden trajectories. 

The primary particles are then propagated inside the inner shell, taking into account 
the bending in the magnetic field and the interactions with the air nuclei. When an 
inelastic interaction occurs, a set of final state particles is generated with a realistic 
distributions, of multiplicity, flavor, energy and transverse momentum. In this calculation 
we have used a simple model of the hadronic interactions due to Hillas [O. A fraction 



of approximately 3% of the primary cosmic rays that enter the inner shell exit without 
interacting. 

The subsequent development of the shower is a standard one. The trajectories of 
charged particles are propagated along curved trajectories because of the presence of the 
magnetic field. When neutrinos are produced their trajectories (simple straight lines) are 
studied. The trajectories intersect n times the surface of the Earth with n = or n = 2. 
If n = the neutrino is discarded. If n = 2 two neutrinos (corresponding to down-going 
and up-going trajectories) are "collected" and their position and direction are recorded. 

Some of the results of our calculation are collected in six figures (from fig. |6| to fig. |TT|). 
For illustration (and debugging purposes) we have performed the calculation three times. 

(i) A first calculation (represented by the thick) histograms was performed using a fully 
3-D method. This includes geomagnetic effects on the primary cosmic ray fluxes, 
and in the shower development the inclusion of realistic p± distributions in hadronic 
interactions, and the correct treatment of the kinematics in particle decays. 

(ii) A second calculation (represented by thin histograms) was performed to reproduce 
the 1-D algorithms. The geomagnetic effects are calculated for the primary cosmic 
ray particles (exactly as in the previous case) but not for the shower development 
(particles travel along straight lines for r < i? e + 80 Km.), and all final state particles 
are collinear with the projectile (or parent) particle. This is achieved modeling the 
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interactions and particle decays exactly as in the previous case, (including therefore 
transverse momentum), and performing as a last step a rotation of all the 3-momenta 
of the final state particles so that they become parallel to the projectile (for interac- 
tions) or parent (for decays) particle. 

(iii) A third calculation (represented by dashed histograms) was performed neglecting 
the geomagnetic effects on the primary flux (therefore considering exactly isotropic 
primary fluxes) and using the 1-D algorithms outlined in the previous point. 

Since the atmospheric neutrino fluxes depend on the geographycal position of the de- 
tector, we have divided the Earth's surfaces into five equal area regions, according to 
the geomagnetic latitude: two polar regions, two intermediate latitude regions and an 
equatorial region, and have collected separately all neutrinos generated in the montecarlo 
calculation that land in the different regions (each neutrino is recorded in two separate 
regions, once as down-going and once as up-going). The results in the two (north and 
south) polar regions and the two intermediate latitude regions are essentially undistin- 
guishable, and therefore only the results for the north regions are presented here. 

The six figures (from ^ to [11]) with the results of our calculation are organized as 
follows: three figures are for //-like events and three for e-like events; in each set the three 
figures correspond to the three different magnetic latitude regions: polar (sin X M = [0.6, 1] 
where \m is the magnetic latitude), intermediate (sin Am = [0.2,0.6]) and equatorial 
(sin X M = [—0.2, +0.2]). In each figure four panels show the zenith angle distributions for 
the event rates in four different neutrino energy intervals. To compute the rates the v 
fluxes have been convoluted with the neutrino cross sections model described in [[HJ. Note 
that the zenith angle is the neutrino one, and no experimental smearing or inefficiency 
has been included. 

The motivation to perform the three different calculations are that a comparison be- 
tween the three allows to put in evidence the different effects that determine the shape of 
the zenith angle distributions of the neutrino fluxes. In fact: 

1. In the calculation (iii) (1-D approximation with no geomagnetic effects) the only 
source of a non-flatness in the zenith angle dependence of the event rates are the 
neutrino yields. 

2. In calculation (ii) (1-D approximation) the zenith angle distributions reflect both the 
geomagnetic effects on the primary cosmic rays, and the zenith angle dependence of 
the neutrino yields. 

3. Finally for the full three-dimensional calculation (i) the zenith angle distributions 
are determined by a combination of all three effects: the geomagnetic effects, the 
neutrino yields and the spherical geometry of the source. 

Note that in the calculation (iii) where geomagnetic fields are neglected and the primary 
cosmic ray fluxes are considered as isotropic the neutrino event rates are independent from 
the detector position, therefore the results (described by the dashed histograms) are equal 
(within the statistical errors of the montecarlo calculations) for the same event type (// 
or e) and same energy range in each of the three regions that correspond to different 
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magnetic latitude. For the other two calculations the neutrino event rates do depend on 
the detector position and therefore the results are different in the three magnetic latitude 
regions. 

Let us consider first the zenith angle distributions of the v fluxes in calculation (iii) 
(1-D with no geomagnetic effects, represented by the dashed histograms in fig. |S|-|rT|). 
For E u < 1 GeV, the v fluxes are essentially isotropic, while with increasing energy the 
fluxes start to develop an enhancement for horizontal directions. This enhancement is due 
to the larger neutrino yields in more inclined showers, and becomes more marked when 
the energy increases as discussed in section f|. Note that the enhancement caused by the 
neutrino yields is more marked for e-like events, reflecting the fact that the effect of the 
shower inclination is especially important for muon decay, that is the source of essentially 
all e-like events and of only a fraction (less or equal to one half) of the \x events. Note also 
that this effect is exactly up-down symmetric, and all dashed histograms remain equal 
(within statistical errors) for a reflection (cos# z — > — cos# z ). 

The zenith angle distributions of calculation (ii) (1-D, represented by thin histograms) 
very clearly display the effect of the geomagnetic cutoffs. This is reflected in two effects: 
the calculated event rates now depend on the detector position and are highest in the 
polar region, and lowest in the equatorial region (the y axis is an absolute scale in fig. ||- 
|TT|) , and the up-down symmetry is broken. For example in the calculations for the polar 
region (fig. ^| and fig. the up-going (cos 6^ < 0) rates are smaller that the down- 
going ones (cos 8 Z > 0) reflecting the fact that the geomagnetic cutoffs above the detector 
(in the magnetic polar region) are lower than average, while up-going trajectories are 
produced everywhere on the Earth. On the contrary in the calculations for the equatorial 
region (fig. |S] and fig. |It]) the up-going rates are larger than the down-going ones that 
are suppressed because of the high geomagnetic cutoffs in the equatorial region. The 
geomagnetic effects become negliglible when the neutrino energy becomes larger than a 
few GeV, reflecting the fact that higher energy neutrinos are produced in the showers of 
higher energy primary particles that are not affected by the geomagnetic effects. 

Finally the 3-D calculation (thick histograms) clearly exhibits the contribution from 
all three sources of zenith angle dependence. A new and remarkable feature is present for 
E u below few GeV's, and is the sharp enhancement for the horizontal directions, whose 
origin we have discussed in section 5. 

It should be noticed that the "geometric" enhancement for the horizontal plane in a 
realistic calculation that includes the geomagnetic effects is stronger than what can be 
estimated assuming that the primary spectrum is isotropic. This can be easily understood 
qualitatively noting that the value of the geomagnetic rigidity cutoff (see eq. §) for a fixed 
position and azimuth grows monotonically with zenith angle from a minimum value for 
the vertical direction to a maximum value on the horizontal plane. The enhancement 
on the horizontal plane, as discussed in the previous section, can be understood as the 
consequence of the fact that there are more "vertical" showers producing "horizontal" z/s 
than vice versa. This is true for an isotropic flux, when the source of the vertical/horizontal 
asymmetry is due to the fact that the zenith angle distribution of the showers is oc 
cos#o (with 9q); the asymmetry between vertical and horizontal showers becomes more 
important when the geomagnetic effects are included, since in this case the horizontal 



17 



primary flux is also suppressed by an higher rigidity cutoff. For a realistic calculation 
the size of the "geometric" horizontal enhancement also depends on the position of the 
detector, reflecting the effect discussed above, and the fact that the energy spectrum of the 
v flux observed in different location changes being softer (harder) at high (low) magnetic 
latitude, and the angle (9 0u ) is correlated with the neutrino energy. 

The "spherical geometry" enhancement can be easily distinguished from the "neutrino 
yield" enhancement since it is most important at low neutrino energy reflecting the higher 
average neutrino-primary angle, and vanishes as the angle 9q v shrinks with increasing E v . 
Conversely the "neutrino yield" enhancement becomes more important as the neutrino 
energy increases. 

7 Conclusions 

In this work we have discussed the different sources that together with neutrino oscillations 
determine the zenith angle distributions of the atmospheric neutrino fluxes. The source 
volume of the atmospheric neutrinos has the shape of a spherical shell, and a simple 
consequence of this geometry is the existence of an enhancement of the flux intensity for 
the horizontal directions. This enhancement is stronger when the neutrinos are emitted 
with a large average angle with respect to the primary particle direction, and therefore it 
is most important at low energy, and disappears for E u > 3-10 GeV when the neutrino 
emission is approximtely collinear with the shower axis. 

The detection of this enhancement is not easy, since the angular resolution for sub-GeV 
neutrinos is poor. This is true for a detector such as Super-Kamiokande that can measure 
only the charged lepton produced in a quasi-elastic scattering (such as v^n — > fi~p) , since 
the angle between the neutrino and the final state charged lepton is large, but it is also 
true || for higher resolution detectors (such as Soudan-2 or Icarus) that are capable of 
detecting the recoil protons. Even in this case the angular resolution will be limited by 
the fact that the spectator nucleons (that are undetected) can absorb a non negligible 
3-momentum, and therefore the vector sum of the recoil nucleon and charged lepton 
momenta does not correspond exactly to the initial neutrino momentum. 

This difficulty in the detection of the enhancement does not imply that the effect is 
negligible when the atmospheric neutrino data is analysed to extract information about 
the oscillation parameters. Several effects can be significant. The most important one is 
a significant modification of the pathlength distributions of the neutrino events. These 
distributions are controlled by the v zenith angle distributions that can very significantly 
distorted by the geometrical effects discussed here. Note also that the height distribution 
of the horizontal neutrinos for a fixed value of the zenith angle, is also modified with respect 
to a 1-D calculation. For example in a 3-D calculation most of the sub-GeV horizontal 
neutrinos are actually produced in less inclined (and deeper developing showers) after 
emission at large angles with respect to the shower axis, and are therefore produced at 
lower altitude with respect to the 1-D case. This effect is second order with respect to 
the distortion of the zenith angle distribution but must also be taken into account. As an 
example, even if the detector resolution is so poor that the shape of the neutrino angular 
distribution is not measurable, in the presence of z/ M <-> v T oscillations the pathlength 
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distribution determines the average (zenith angle integrated) suppression of the /i-like 
event rate for a given set of oscillation parameters. 

The geometrical effects can also be a non negligible correction for the calculation of the 
fi/e ratio. The enhancement for the horizontal directions depend in fact on the average 
angle (9 0u ) between neutrino and primary particle and on the average altitude of the 
neutrino production. Both these quantities are slightly different for neutrinos produced 
directly in meson decay or in the chain decay of a muon, and are therefore also slightly 
different for electron and muon (anti)-neutrinos. 

Also the absolute observable rates for sub-GeV neutrino events depend on these effects. 
The absolute rate is not important in the determination of the oscillation parameters, but 
the consistency of data and prediction also for the absolute rate is certainly desirable. 

The improved calculation of the atmospheric v fluxes is now an active field of research, 
strongly stimulated by the great importance of the discovery of the existence of flavor 
transitions for these neutrinos. New improved calculations will be important in the de- 
tailed interpretation of the existing and future data on atmospheric neutrinos, and in the 
unbiased determinations of the v oscillation parameters (or other parameters describing 
the new physics of the flavor transitions). New measurements of the primary cosmic rays 
have been recently performed [19|, [2(J, and have to be included in a new fit for the primary 
cosmic rays, and at the same a significant effort has been dedicated to the developoment 
of improved modeling of hadronic interactions in cosmic ray showers. Because of these 
developments in the field we postpone to a future work a quantitative discussion of a new 
estimate of the oscillation parameters. The newly recognizied geometric effects that we 
have discussed in this work will be important in these future calculations. 
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Figure 6: Average zenith angle distributions for /i-like events for detectors located in positions on the 
Earth with magnetic latitude sin Am > 0.6 (magnetic north polar region). The four panel are for different 
neutrino energy intervals. The three histograms are for: fully 3-D calculation (thick), 1-D calculation 
(thin), 1-D without geomagnetic effects (dashed). 
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Figure 7: Average zenith angle distributions for /i-like events for detectors located in positions on the 
Earth with magnetic latitude sin Am = [0.2,0.6]. The four panel are for different neutrino energy inter- 
vals. The three histograms are for: fully 3-D calculation (thick), 1-D calculation (thin), 1-D without 
geomagnetic effects (dashed). 
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Figure 8: Average zenith angle distributions for /i-like events for detectors located in positions on the 
Earth with magnetic latitude sin Am = [—0.2, +0.2] (magnetic equatorial region). The four panel are 
for different neutrino energy intervals. The three histograms are for: fully 3-D calculation (thick), 1-D 
calculation (thin), 1-D without geomagnetic effects (dashed). 
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Figure 9: Average zenith angle distributions for e-like events for detectors located in positions on the 
Earth with magnetic latitude sin Am > 0.6 (magnetic north polar region). The four panel are for different 
neutrino energy intervals. The three histograms are for: fully 3-D calculation (thick), 1-D calculation 
(thin), 1-D without geomagnetic effects (dashed). 
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Figure 10: Average zenith angle distributions for e-like events for detectors located in positions on 
the Earth with magnetic latitude sin Am = [0.2,0.6]. The four panel are for different neutrino energy 
intervals. The three histograms are for: fully 3-D calculation (thick), 1-D calculation (thin), 1-D without 
geomagnetic effects (dashed). 
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Figure 11: Average zenith angle distributions for e-like events for detectors located in positions on 
the Earth with magnetic latitude sin Am = [0.2,0.6]. The four panel are for different neutrino energy 
intervals. The three histograms are for: fully 3-D calculation (thick), 1-D calculation (thin), 1-D without 
geomagnetic effects (dashed). 
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